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DIGITAL TELEVISION TRANSMISSION WITH ERROR CORRECTION 

Hie invention is related to the field of digital television transmission through a 
noisy medium witiii error correction. Hie noise in the medium results in errors in the 
received data which require error correction for reasonable display quality. 

Digital multimedia data streams such as MPEG streams are extremely vulnerable 
to transmission errors. If error correction is not provided, then even a one bit error could 
prevent the decoding of significant portions of the MPEG stream. Proposed digital 
television standards such as the proposed ATSC standard for DTV and the proposed 
DVB standard, provide forward error correction data that can correct some of the errors 
that occur during transmission. The error correction data is typically redundant data in the 
form of parity bits. The amount of errors that can be corrected by an error correction 
scheme, depends on the amount of error correction data that is provided in the scheme. 
Small errors such as random single bit errors are more common than large burst errors so 
that a small amount of error correction data is sufiBcient to correct most errors. Also, no 
practical amount of error correction data can eliminate all possible transmission errors. 
Thus, these proposed standards are based on a trade off between the robustness of the 
error correction and the amount of error correction data that has to be transmitted. 

The proposed digital television technologies provide acceptable reception for low 
noise transmission channels such as those provided by current cable and satellite 
television transmission schemes. However, there is a need to provide more robust error 
correction for television transmission through noisier channels such as extended cable 
systems, terrestrial broadcast, internet transmission, cell phone transmission, and wireless 
network transmission chaimels. 

Recently, schemes for unequal protection or prioritized protection of video data 
has been widely proposed in the literature. These schemes take advantage of the fact that 
errors in some portions of digital multimedia stream are more critical than errors in other 
portions of the stream. An error in an important portion of the digital multimedia stream 
can cause loss of significant data, for example, an error in the header of an MPEG video 
I-firame can prevent decoding of an entire group of video firames, an error in an audio 
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frame can result in an unintelligible word. However, an error in a less important portion 
of the digital nciultimedia stream might not even be perceivable. 

In proposed unequal protection schemes, the digital multimedia stream is divided 
up into different portions of different types of data that contribute different amounts to 
the quality of the presentation. Then the portions of the type of data that contributes more 
to the presentation quality are made more robust than portions of other types of data by, 
for example, providing more data redundancy or by providing for more retries to 
correctly transmit the more important types of data. Commonly in these schemes, the 
transmission channel that is used to transmit the multimedia stream is divided time-wise 
for tiie different portions of the video signal. 

A chanxiel is a portion of a conununication resource through which 
communication signals can be transmitted, the transmission of signals through one 
channel being substantially independent of any transmission of other signals through 
other channels of the communication resource. A channel conununication is a signal 
transmission through a channel. A chaxmel has predetermined properties such as a 
predetermined transmission rate or bandwidth that is substantially independent of 
communications through other channels. For example, a channel may be a conductive 
path through which electrical signals are transmitted or a frequency band over which 
electro-magnetic signals are transmitted. Only one transmitter at a time can transmit 
information through the same channel. The resource may be a medium or a series of 
different mediums. A Chaimel may be divided or sliced into multiple chatmels, for 
example, by time slicing and/or frequency slicing a channel, so that different transmitters 
can independently transmit different signals tfirough different slices of the same channel. 
Each slice of a channel that provides substantially independent transmission is also 
referred to as a. chatmel. Herein, channels are defined from the viewpoint of the 
transmitter and receiver. That is, a communication resoiirce through which a signal is 
transmitted is considered a channel as long as the transmission and reception of the signal 
is substantially independent of the communication through other channels. 

Communications through switched packet networks, like the internet, are not 
restricted to chaimels wittiin the switched packet network, but typically such 
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communications are restricted to chamiels into and out of the internet so that they meet 
the above definition for channel conununication. 

Those skilled in the art are directed to the following citations which are hereby 
incorporated in whole by reference. 

• "PES packets and elementary streams" in "Comprehensive MPEG2 Video 
Compression Tutorial" by Wayne E. Bretl and Mark Fimofl^ January 15, 2000, at 
www.bretl.com 

• "ATSC Standard A/53: Digital Television Standard", August 2001, at 
ht^://www.atsc.org 

In the multimedia stream transmitter of the invention, the stream transmitter 
receives a standard multimedia data stream. The stream contains encoded multimedia 
data and uniform error correction data that is useful for error correcting the encoded 
multimedia data. The uniform error correction data provides substantially the same 
robustness of error correction for each portion of the encoded multimedia data of the 
standard multimedia data stream. The transmitter selects some stream portions of the 
encoded multimedia data stream but not other stream portions of the encoded multimedia 
data stream. The selection depends on the importance of the selected stream portions to 
ttie correct decoding of the encoded multimedia data. The transmitter generates selection 
map data indicating which of the stream portions were selected. The transmitter also 
generates additional imequal error correction data for error correcting the selected stream 
portions and does not generate such additional unequal error correction data for the other 
stream portions that were not selected. The transmitter transmits the standard multimedia 
stream through a first channel and transmits enhancement data including the selection 
map data and the additional unequal error correction data through a second channel. The 
second chaimel is a different channel than the first channel, that is, the transmission of 
information signals through the first channel is independent of tfie transmission of 
information signals through tihe second channel. 

In the multimedia data stream receiver of the invention, the receiver receives the 
standard multimedia data stream from the first channel, and the enhancement data fi-om 
tile second channel. The receiver selectively error corrects the selected portions of the 
standard multimedia data stream according to the selection map data using the additional 
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unequal error correction data. The receiver also uniformly error corrects all the encoded 
multimedia data using the uniform error correction data. 

The advantages of the combination of uniform error correction in combination 
with additional unequal error protection for critical portions of the multimedia data 
include that most errors in the less critical portions of the multimedia data are corrected 
while even more extensive errors are corrected in more critical portions of the encoded 
multimedia data. The advantages of transmitting the standard multimedia data stream 
with uaiform error correction through a first channel and the unequal error correction 
througih. the second channel include that the standard multimedia data stream with 
unifom error correction is compatible with a receiver that only receives the standard 
stream j&om the first channel and does not receive the enhancement data from the second 
channel. Thus the transmitter of the invention can be used for a standard receiver that 
does not utilize the invention. In a broadcast embodiment where multiple receivers at 
different locations receive signals from the same transmitter of the invention, and some 
receivers receive a noisier signal than other receivers, the receivers that receive the 
noisier signal can utilize the invention to obtain improved quality of reception, while less 
complex receivers that do not utilize the invention, can be used to receive a less noisy 
signal. 

The transmitter may generate third error correction data portions useful for error 
correcting the enhancement data. The third error correction data can provided 
substantially the same imiform robustness of error correction for each portion of the 
enhancement data. The receiver may error correct tiie enhancement data before error 
correcting the selected portions of the standard stream. The transmitter may generate an 
enhancement stream of enhancement transmission frames. Each enhancement 
transmission frame may include a fixed-size portion of the enhancement data and a fixed- 
size portion of the third error correction data. 

The standard stream may contain fixed-size elementary stream packets, the 
packets each containing a packet header and a packet data portion. The packets may 
include video packets which contain video data in their packet data portion and audio 
packets which contain audio data in their packet data portion. 
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The standard stream may be organized into fixed-size standard transmission 
fi-ames, each standard transmission frame containing a fixed-size portion of the encoded 
multimedia data and a fixed-size portion of the uniform error correction data. The 
uniform error correction data contained in each frame may be for error correcting the 
encoded multimedia data contained in the same frame. 

The standard transmission fi:Bmes may be logically organized into groups of 
multiple standard transmission firames for efiGciently generating and organizing selection 
map data and unequal error correction data for the selected portions of encoded 
multimedia data. The selecting of portions of encoded multimedia data may include: 
selecting substantially all tiie audio portions; selecting substantially all the video portions 
that contain video header information; and selecting sequences of video portions 
immediately following each video portion containing the video header data, the nimiber 
of portions in the sequence depending on a predetermined bit rate for tiie second 
transmitting. Hie selection map data and/or unequal error correction data may each be 
transmitted in the same order as the encoded multimedia data portions for which they are 
generated are transmitted. Alternatively, the selection map data and/or imequal error 
correction data may be transmitted in an interleaved order with respect to the order that 
the encoded multimedia data portions for which they are generated are transmitted. 

The enhancement data for each group of standard transmission frames may be 
organized into multiple fixed-size enhancement data transmission portions. A 
corresponding fixed-size third error correction portion may be generated for each 
enhancement data transmission portion. An enhancement data stream of fixed-size 
enhancement transmission fi'ames may be generated by the transmitter, with each of 
multiple enhancement transmission firames containing one of the enhancement data 
transmission portions and one of the third error correction portions for the group of 
standard frames. The third error correction portion in each enhancement transmission 
fi-ame may be for error correcting the enhancement data contained in the same 
enhancement transmission frame. 

Each enhancement data transmission portion may contain a fixed-size portion of 
the selection map data and a fixed-size portion of the additional unequal error correction 
data. Alternatively, all the selection map data may be sent together in subsequent sections 
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of the enhancement data transmission portions and also all tfie additional unequal error 
correction data may be sent together in other subsequent sections of the enhancement 
data transmission portions. 

The selected stream portions may include audio portions and video portions and 
the selection may include selecting substantially all of tiie audio portions and selecting all 
the video portions that contain video header information and selecting sequences of video 
portions that inamediately follow tiie video portions that contain header information, the 
size of the sequences depending on a predetermined bit rate for the transmission of the 
enhancement data stream. 

In the case where the packets are organized into multiple segments and the 
selected stream portions are packet segments, then the selected stream portions should 
also include the packet header of any packet containing a selected packet segment. 

The standard multimedia data stream may be transmitted through the jBrst channel 
by using the standard multimedia data stream to modulate a first analog carrier wave at a 
first carrier fi-equency and transmitting the first modulated carrier wave through a 
physical media. The enhancement data stream may be transmitted through a second 
channel by using the enhancement data stream to modulate a second analog carrier wave 
at a second carrier firequency that is diflferent than the first carrier frequency and 
transmitting the second modulated carrier wave through the physical media. 

Additional aspects and advantages of the invention will become readily apparent 
to those skilled in the art fi'om the detailed description below with reference to the 
following drawings. 

Figure 1 shows an example embodiment of the multimedia transmitter of tiie 
invention. 

Figure 2 illustrates a portion 120 of an example standard multimedia data stream. 

Figure 3 illustrates an example group of 4 standard frames in which the uniform 
error correction data for error correcting packets is interleaved. 

Figure 4a illustrates an example of the selection of portions in a group of 4 
standard transmission fi:Bmes of the standard multimedia data stream in the invention. 

Figure 4b illustrate a first example embodiment of the selection map data for the 
selected portions of figure 4a. 
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Figure 4c illustrates a first example embodiment of the unequal error correction 
data of the invention. 

Figure 4d illustrates anotiier example embodiment of the selection map data of the 
invention in which the selection map data is interleaved with respect to the order of the 
portions of the standard stream for which the selection map data was generated. 

Figure 4e illustrates another example embodiment of the unequal error correction 
data of the invention in which the unequal error correction data is interleaved with respect 
to Ihe order of portions of the standard stream for which the unequal error correction data 
w^as generated. 

Figure 5 illustrates an example embodiment of an enhancement transmission 
jQrame of the invention. 

Figure 6a illustrates a first example embodiment of the organization of the 
selection map data and unequal error correction map data into the enhancement data 
transmission portions of a group of enhancement transmission frames for the group of 
standard transmission fi'ames shown in figure 4a. 

Figure 6b illustrates a second example embodiment of the organization of the 
selection map data and additional imequal error correction data into the enhancement data 
transmission portions of a group of enhancement transmission fi-ames for tiie group of 
standard transmission firames shown in figure 4a. 

Figure 7 illustrates a more detailed example embodiment of the multimedia 
transmitter of the invention. 

Figure 8 shows an example embodiment of the multimedia receiver of the 
invention. 

Figure 9 illustrates a more detailed embodiment of the multimedia receiver of the 
invention. 

Figure 10 is a flow diagram illustrating an example embodiment of the method of 
the invention. 

In the following descriptions of the drawings, the use of the same labels in 
different figures indicate similar apparatus. 

Figure 1 shows an example embodiment of Ihe multimedia transmitter 100 of the 
invention. Receiver 110 provides multimedia data to signal processor 1 12. A standard 
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multimedia data stream is provided by receiver 110 alone or in combination with signal 
processor 112. The standard stream includes encoded multimedia data and imiform error 
correction data. The uniform error correction data provides substantially the same 
robustness of error correction for each portion of the encoded multimedia data. 

Receiver 110 may include for example, an input for receiving multimedia data, a 
media drive to read multimedia data from a record carrier, and a camem and microphone 
for receiving the multimedia data from the environment. The receiver may receive the 
standard multimedia data stream; or the receiver may receive encoded multimedia data in 
which case, the signal processor generates the error correcting data and formats the 
encoded multimedia data and error correction data into the standard multimedia steam; or 
the receiver may only provide raw multimedia data in which case, the signal processor 
also encodes the raw data into encoded multimedia data. 

Signal processor 1 12 selects some stream portions of the standard multimedia 
data stream but not other stream portions of the standard multimedia data stream. The 
selection depends on the importance of the type of data contained in the stream portions 
to the quality of the presentation of the multimedia data. The signal processor also 
generates selection map data indicating which of the stream portions were selected. The 
signal processor also generates additional unequal error correction data for the selected 
stream portions and not for other stream portions that were not selected. 

Transmitter 114 transmits the standard multimedia data stream into a first 
channel, and transmits enhancement data including the selection map data and tiie 
additional unequal error correction data into a second channel. The second channel is a 
different channel than the first channel. Thus, both uniform error correction data and 
unequal error correction data are provided for the selected portions of the standard 
stream, and at least uniform error correction data is provided for the portions of the 
standard stream that are not selected. 

Figure 2 illustrates a portion 120 of an example standard multimedia data stream. 
The standard stream may for example, conform to a proposed ATSC DTV standard or a 
proposed DVB standard. The stream may consist of sequentially fixed-size standard 
transmission frames. Each standard frame may contain a fixed-size multimedia data 
portion 122 of encoded multimedia data followed by a fixed-size uniform error correction 
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portion 124 of uniform error correction data that can be used for error correcting the 
encoded multimedia data. The error correction data in die standard frame may be for 
example, forward error correction (FEC) data. The encoding may be for example, MPEG 
type encoding (e.g. MPEG-2 encoding) in which case, the encoded multimedia data 
consists of fixed-size 188 byte elementary stream packets, each packet having a packet 
header and a packet data portion, the packet heading including an ID, the packet data 
portions containing the encoded multimedia data. For an MPEG encoded standard 
stream, each multimedia data portion may contain a fixed integral nimiber of MPEG 
packets. For television, the packets of an MPEG stream typically include video packets 
with packet data portions containing only video data and audio packets with packet data 
portions containing only audio data. 

The error correction data in each standard frame may be for error correcting the 
encoded multimedia data only in that same standard frame, or it may also be for error 
correcting the encoded multimedia data in other standard frames. Figure 3 illustrates a 
group of 4 standard frmnes in which the imiform error correction data for error correcting 
packets is interleaved in different order than the order of the packets in the standard 
frames. For example in figure 3, uniform error correction data B', C and D' for error 
correcting respective packets B, C and D are contained in different standard frames of the 
group of frames than packets B, C, and D. 

Channels are considered to be different when the transmission of a data signal in 
one channel is substantially independent of the transmission of a data signal in another 
channel. For example, in broadcasting, channels are typically different frequency bands 
of the electro-magnetic spectra, while in TDMA cellular systems different channels are 
often different predetermined time slices of the same frequency band. In spread spectrum 
communications (such as CDMA cellular systems), a channel includes time slices of 
multiple frequency bands. However, a scheme for djmamic allocation of the same 
channel to multiple transmitters depending on varying data rates would not be considered 
substantially independent transmission. 

For example, transmitter 1 14 can use the standard multimedia stream to modulate 
a first analog carrier wave at a first frequency and transmit the modulated carrier wave 
into a medium and then use the enhancement data stream to modulate a second analog 
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carrier wave at a second frequency that is different than the first frequency and transmit 
the second modulated carrier wave into the medium. In this case the medium could be 
any substance that can transmit waves such as sound or electro-magnetic waves. The 
transmitter may, for example, include a laser for transmitting light waves through an 
optical fiber, or an antenna for transmitting radio waves or micro waves through space. 

Figure 4a shows an embodiment of a group of 4 standard transmission frames of 
the standard multimedia data stream with selected portions of the standard stream 
indicated by letters. Portions of the standard stream that were not selected are blank. The 
selected portions may include portions of the uniform error correction data or selection 
may be restricted to include only the encoded multimedia data as shown in figure 4a. The 
selected portions may be MPEG packets or they may be packet segments which are 
subdivisions of the MPEG packets. For example, if the packets each contains 188 bytes, 
then each packet can be logically subdivided into 6 packet segments wherein the first 5 
packet segments each contain 32 bytes and the 6th packet segment contains 28 bytes. 

The number of standard frames in a group (i.e. group size) depends on tradeoff 
among delay, buffering requirements, and bandwidth efficiency. For example, a larger 
group of standard frames, introduces more delay in processing the standard frames (and 
delay in processing the enhancement data), and requires larger buffers to hold the data, 
but results in more efficient packaging of the enhancement data resulting in higher 
bandwidth efficiency. 

Figure 4b illustrates a first example embodiment of the selection map data of the 
invention, the selection map data being for the selected portions shown of figure 4a. In 
this embodiment, the selection map is a bit map in which a 1 indicates that a 
corresponding portion of the standard frame was selected and a 0 indicates that tiie 
corresponding portion of the standard frame was not selected. The O's are not shown in 
figure 4b in order to simplify the illustration. 

Figure 4c illustrates a first example embodiment of the unequal error correction 
data of the invention. Figure 4c shows the error correction data for error correcting the 
selected portions of figure 4a. For example, error correction data A', B', C are for error 
correcting selected packets A, B, C respectively in the standard frames of figure 4a. 
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Figure 4d illustrates another example embodiment of the selection map data of the 
invention in which, the selection map data is interleaved with respect to tiiie order of the 
portions of the standard stream for which the selection map data was generated. For 
example, the first four bits in the first row of the selection bit map of figure 4d indicates 
whether the first packet of each of the 4 standard frames were selected. 

Figure 4e illustrates another example embodiment of the unequal error correction 
data of the invention in which the unequal error correction data is interleaved with respect 
to the order of portions of the standard stream for which the unequal error correction data 
was generated. In figure 4e, the first two portions of imequal error correction data A' and 
M' are for error correcting packets A and M respectively. Altematively, the selection map 
data may be in the form shown in figure 4b while the unequal error correction data may 
be in the form shown in figure 4e so that flie unequal error correction data in interleaved 
with respect to the selection map data. 

In figure 1, signal processor 112 may also generate third error correction data for 
error correcting the enhancement data. The third error correction data provide 
substantially the same uniform error correction for all of the enhancement data. In this 
case, transmitter 1 14 would also transmit the tiiird error correction data with the 
enhancement data through the second chaimel. 

Signal processor 112 may organize the enhancement data into an enhancement 
data stream of fixed-size enhancement transmission fi-ames. Figure S illustrates a portion 
of an example embodiment of an enhancement data stream. Each enhancement 
transmission fiame consisting of a fixed-size enhancement data transmission portion 132 
containing enhancement data and a fixed-size third error correction transmission portion 
134 containing third error correction data for error correcting the enhancement data. In 
this case, transmitter 1 14 would transmit the enhancement stream into the second 
channel. 

The third error correction data in each enhancement transmission fiame may be 
forward error correction data. The error correction data in each enhancement transmission 
fi-ame may be for error correcting the enhancement data in tiiat same enhancement 
transmission fi-ame, or it may also be for error correcting enhancement data in other 
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enhancement transmission frames in a manor similar to the interleaving of error 
correction data in the standard frames in figure 3. 

Figures 6a and 6b illustrate different example embodiments for organizing the 
selection map data and uneqxial enhancement map data into the enhancement data 
transmission portions of a group of enhancement transmission frames for the group of 
standard transmission fiumes shown in figure 4a. The number of frames in a group of 
enhancement transmission firames will depend on the number of frames in the 
corresponding group of standard frames and on the proportion of the portions of the 
standard fi*ames.that are selected for providing the additional unequal error correction. In 
figure 6a, each of the 3 enhancement transmission firames includes a fixed-size portion 
142 of the selection map data of figure 4b followed by a fixed-size portion 144 of the 
unequal error correction data of figure 4c followed by a portion 146 of the third error 
correction data. In figure 6b subsequent portions ISO and 152 of selection map data are 
contained in the first two enhancement transmission firames. The selection map data is 
followed by subsequent portions 154 and 156 of unequal error correction data. Typically, 
the selection map data will be much smaller than imequal error correction data. 

The signal processor 1 12 selects tiie portions of the standard multimedia data 
stream that contain the most important types of data for maintaining the quality of the 
multimedia presentation. The most important portions of tfie data depends on the type of 
multimedia data contained in the standard data stream. Audio portions should be selected 
because the audio data is typically only a small proportion of the multimedia data and 
audio is generally more important to the understanding of multimedia presentation than 
other portions. Even relatively small losses of audio data can render an presentation 
unintelligible. For an MPEG based standard stream of packets, the audio packets can be 
identified by the packet ID. Also, video portions containing header information should be 
selected because header information is critical for decoding other video data. The video 
header information in a typical MPEG video stream includes firame headers, slice 
headers, macroblock headers, and block headers. For an MPEG based standard stream, 
the packets have to be parsed to identify portions containing video headers. Finally, 
sequences of subsequent video portions (that immediately follow any video portion tiiat 
contains header information) should also be selected, the number of video portions in the 
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sequences of video portions may depend on a predetermined criteria. The predetermined 
criteria may include a proportion of the packets that are to receive enhanced protection, 
the proportion of packets being dynamically adjusted to at least approximately provide a 
predetermined bit rate for tiie second transmitting. 

When the standard multimedia signal consists of packets and the packets are 
logically subdivided into segments which are the portions that are selected, then when 
any segment of a packet is selected, then the packet headers for the selected segments 
should also be selected, because the packet header is critical for decoding the packet. 

Figure 7 illustrates a more detailed example embodiment of the multimedia 
transmitter 200 of the invention. Receiver 202 provides raw multimedia data. Encoder 
204 converts the raw multimedia data into encoded multimedia data. Error correction 
coder 206 generates uniform error correction data for the encoded multimedia data, the 
uniform error correction data providing substantially the same robustness of error 
correction for each portion of the encoded multimedia data. Multiplexer 208 formats the 
encoded multimedia data and the uniform error correction data to provide a standard 
multimedia data stream. Selector 210 selects some stream portions of the standard 
multimedia data stream but not other stream portions of the standard multimedia data 
stream for additional unequal error correction, and generates selection map data 
indicating which of the stream portions were selected for the additional unequal error 
correction. The selection depends on the importance of the type of data contained in the 
stream portions to the quality of the presentation of the multimedia data. Error correction 
coder 212 generates additional unequal error correction data for the selected stream 
portions indicated by the selection map data and not for other stream portions that were 
not selected. Multiplexer 214 formats the unequal error correction data and the selection 
map data together to provide enhancement data transmission portions. Error correction 
coder 216 generates third error correction data for error correcting the enhancement data 
transmission portions. Multiplexer 218 formats the enhancement data transmission 
portions and enhancement error correction data togetiier to provide an enhancement data 
stream. The data stream may consist of enhancement transmission firames as described 
above in relation to figure 5. 



wo 2005/034521 



PCT/IB2004/051933 



14 

Transmitter 220 transmits the standard multimedia data stream into a first 
channel, and transmitter 222 transmits the enhancement data stream into a second 
channel, the second channel being different than the first channel. 

The elements of the embodiment of figure 7 are described as separate components 
but in an efBcient design, portions of tiiie components may be shared, and it is expected 
that in a commercial embodiment, some portions of die multimedia transmitter will be 
implemented in software and other portions will be implemented in hardware. 

Figure 8 shows an example embodiment 230 of the multimedia receiver of the 
invention that uses both the uniform error correction data and the unequal error correction 
data for error correcting a standard multimedia data stream. Receiver 232 receives a 
standard multimedia data stream from a first channel, the standard stream containing 
encoded multimedia data and imiform error correction data. Receiver 232 also receives 
enhancement data including selection map data and unequal error correction data from a 
second channel, the second channel being different tihan the first channel. 

Processor 234 first error corrects portions of the standard stream according to the 
selection map data using the additional unequal error correction data. The selection map 
data indicates which portions of the standard stream are to be corrected in the first 
correcting and which other portions of die standard stream are not be corrected in the first 
correcting. Processor 234 also second error corrects all the encoded multimedia data 
using the uniform error correction data, the uniform error correcting providing 
substantially the same robustness of error correction for each portion of the multimedia 
data of the standard stream. Any portion of the multimedia data that can not be error 
corrected may be discarded. Transmitter 236 outputs the error corrected encoded 
multimedia data to a medium after the first and second error correcting of the data. 
Transmitter 236 may include: a display for presenting the multimedia data to an audience, 
a recorder for recording the multimedia data on a record carrier, an optical laser 
transmitter for transmitting the multimedia data through an optical cable, an antenna for 
transmitting tiie multimedia data through space, and/or any otiier type of media into 
which signals can be transmitted. 

Either the uniform error correction or the imequal error correction may preformed 
first on each portion of the multimedia data. However, if portions of the uniform error 
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correction data were selected for additional unequal error correction, then they should be 
error corrected before they are used for the uniform error correction. 

The enhancement data received by receiver 232 from the second channel may be 
in any of the forms of the enhancement data described as being transmitted by transmitter 
1 14 of figure 1 or transmitter 222 of figure 7. For example, it may accompany third error 
correction data or it may be formatted into enhancement transmission fiximes as described 
above. 

The output of transmitter 236 may be the error corrected standard multimedia data 
stream or just the error corrected multimedia data without the uniform error correction 
data. 

Signal processor 234 may also decode the encoded multimedia data to provide 
raw multimedia data. In that case transmitter 236 may include a simple presentation 
device (e.g. a television without an MPEG decoder) for presenting the decoded 
multimedia data to an audience. 

Figure 9 illustrates a more detailed embodiment of the multimedia receiver of the 
invention. A first receiver 252 receives a standard multimedia data stream from a first 
channel. The standard stream contains encoded multimedia data and uniform error 
correction data for error correction of the multimedia data. The uniform error correction 
data provides substantially the same robustness of error correction for each portion of the 
encoded multimedia data. 

Second receiver 254 receives enhancement data including selection map data and 
additional unequal error correction data from a second channel. The second receiver also 
receives third error correction data from the second channel. The second channel is a 
different channel dian the first channel. 

First error correction unit 256 error corrects the enhancement data using the third 
error correction data. Second error correction unit 258 provides a first error correcting of 
portions of the standard data stream according to the selection map data using the 
additional unequal error correction data. Third error correction unit 260 provides a 
second error correcting of the encoded multimedia data using the uniform error correction 
data. Decoder 262 converts the encoded multimedia data (after the first and second error 
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correcting) into decoded (raw) multimedia data. Transmitter 264 outputs tiie decoded 
multimedia data after the first and second error correcting of the data. 

Figure 10 is a flow diagram illustrating a specific example embodiment of the 
method of the invention. In step 302 raw multimedia data is provided. Raw means tiiat 
the data is not yet encoded. The raw data may be provided from a data capture devices 
such as a cameras and microphones or other well known methods may be used for 
providing multimedia data. The raw data may be analog or digital data. In step 304 the 
multimedia data is encoded to provide encoded multimedia data. MPEG encoding may be 
used for compressing video. There are a large mmiber of currentiy used and proposed 
method for encoding multimedia data that could be used in the invention. The encoding 
may include digitalizing analog multimedia data. In step 306, unifonn error correction 
data is generated. The uniform error correction data is useful for error correcting the 
encoded multimedia data. The imiform error correction data provides substantially the 
same robustness of error correction for all portions of the encoded multimedia data. In 
step 308, a standard multimedia data stream of sequential standard transmission frames is 
generated. Each standard frame contains a fixed-size portion of the encoded multimedia 
data followed by a fixed-size portion of the uniform error correction data. 

In step 310, some stream portions of the standard multimedia data stream are 
selected but other stream portions of the multimedia data stream are not selected. The 
selection depends on the importance of the type of data contained in the stream portions 
to the quality of the presentation of the multunedia data. In step 312, selection map data 
indicating which stream portions were selected is generated. In step 314, additional 
unequal error correction data is generated for each selected stream portion and not for the 
other stream portions that were not selected. Thus, additional unequal error correction 
data is provided for the more important portions of the standard stream. 

In step 316, third error correction data is generated for error correcting the 
enhancement data. The enhancement data includes the selection map data and the 
additional unequal error correction data. The tiiird error correction data provides 
substantiaUy the same uniform error correction for all portions of the enhancement data. 
In step 318, an enhancement data stream of fixed-size enhancement transmission frames 
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is generated, each enhancement transmission frame contains a fixed-size portion of 
enhancement data and a fixed-size portion of the uniform error correction data. 

In step 320, the standard multimedia data stream is transmitted into a first channel 
of a medium. In step 322 the enhancement data stream is transmitted into a second 
channel of the same or a different medium. The second channel is a different channel 
than the first channel. 

In step 324, the standard multimedia data stream is received from the first 
channel. In step 326, the enhancement data stream is received from the second channel. 
In step 328, the enhancement data is error corrected using the third error correction data 
of the enhancement data stream. In step 330, tiie selected stream portions are error 
corrected according to the selection map data using the additional unequal error 
correcting data. In step 332, all of the encoded multimedia data portions are error 
corrected using the uniform error correction data. 

The invention has been described above in relation to specific example 
embodiments. Those skilled in the art will know how to modify these example 
embodiments within the scope of the invention herein. The invention is only limited by 
tiie following claim. 



